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(54) METHOD AND DEVICE FOR GENERATING VIRTUAL VIEWPOINT IMAGE 

(57)Abstract 

PROBLEM TO BE SOLVED: To make generable a 
smooth virtual viewpoint image by a relatively simple 
processing by relieving the positional limitation for a 
virtual viewpoint capable of being generated in a virtual 
viewpoint image generating method generating an image 
seen from a viewpoint position where a camera is not 
actually placed. 

SOLUTION: Two or more depth maps are generated 
from plural images of different viewpoints (101 to 106), 
and a virtual viewpoint depth map seen from a virtual 
viewpoint is generated on the basis of the depth maps 
(107). The depth value of an area being invisible from a 
certain viewpoint is interpolated with information from 
another viewpoint, a pixel whose depth value is not 
decided is subjected to linear interpolation by using the 
depth values of ambient pixels and is further subjected 
to smoothing processing (108 and 109). Then, the pixels 
of a multi viewpoint image (real image) are rearranged on 
the basis of the virtual viewpoint depth map to 
reconfigure a virtual viewpoint image. 
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